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Abstract 

Background: Patient safety is of the utmost importance in health care. The patient safety culture in an institution 
has great impact on patient safety. To enhance patient safety and to design strategies to reduce medical injuries, 
there is a current focus on measuring the patient safety culture. The aim of the present study was to describe the 
patient safety culture in an ED at two different hospitals before and after a Quality improvement (Ql) project that 
was aimed to enhance patient safety. 

Methods: A repeated cross-sectional design, using the Hospital Survey On Patient Safety Culture questionnaire 
before and after a quality improvement project in two emergency departments at a county hospital and a 
university hospital. The questionnaire was developed to obtain a better understanding of the patient safety culture 
of an entire hospital or of specific departments. The Swedish version has 51 questions and 15 dimensions. 

Results: At the county hospital, a difference between baseline and follow-up was observed in three dimensions. 
For two of these dimensions, Team-work within hospital and Communication openness, a higher score was measured 
at the follow-up. At the university hospital, a higher score was measured at follow-up for the two dimensions 
Team-work across hospital units and Team-work within hospital. 

Conclusion: The result showed changes in the self-estimated patient safety culture, mainly regarding team-work 
and communication openness. Most of the improvements at follow-up were seen by physicians, and mainly at the 
county hospital. 

Keywords: Patient safety, Patient safety culture, Patient safety climate, Quality improvement, Team-work 



Background 

Patient safety and medical injuries 

Patient safety can be described as the avoidance, preven- 
tion and amelioration of adverse outcomes or injuries that 
stem from the process of healthcare [1]. Patient safety is of 
the utmost importance for health care, and the World 
Health Organization has stated that patient safety is a 
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fundamental principle of health care. In Sweden, this is 
regulated by law [2] . 

A survey by the Swedish National Board of Health and 
Welfare showed that almost 9% of Swedish patients in 
somatic in-patient care experienced a preventable adverse 
event [3]. Failures in communication and team-work are 
frequent contributors to medical injuries in health care 
[4]. Communication failures are the leading causes of in- 
advertent patient harm. According to the Joint Commis- 
sion on Accreditation of Healthcare Organizations in the 
United States of America (USA), 70% of all negative events 
are caused by communication failures [5]. The lack of 
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standardized procedures and standardized ways to com- 
municate in health care increases the importance of the 
creation of a common mental model for communication 
[5]. Increased leadership standards, team-work and multi- 
disciplinary collaboration in patient care are associated 
with lower mortality rates and reductions in hospital 
stay [6-8]. 

Patient safety in the emergency department (ED) 

Since the majority of the patients come to an ED with 
symptoms and without a clear-cut diagnosis, it is im- 
perative that health care professionals are highly skilled 
and well trained to perform high quality care based on 
basic principles. Common problems and deficiencies in 
the ED that may lead to patient safety risks or damage 
are related more to overcrowding, communication failure 
in connection with transfers and a lack of team-work, than 
to medical mishaps or lack of knowledge [9]. Handover 
and transition of patients have become focuses of efforts 
towards reducing errors. Up to 50% of errors in communi- 
cation occur during hand-off [9,10]. Thus, patient hand- 
offs at shift changes in an ED are an important safety 
process and a critical moment [11]. The safety aspects of 
the transfer of patients from an ED to an admitting phys- 
ician are insufficiently studied. However, associations with 
adverse events have been observed when patients are 
transferred from the ED to an internal medicine ward [9]. 
Specifically vulnerable areas include patient flow, work- 
load, communication, information technology, assign- 
ments of responsibility and environment. In addition, 
the working environment, which demands constant 
multitasking, is a challenge [12]. System-based interven- 
tions may prevent many of these adverse events and 
consequently improve patient safety [9,13]. 

Patient safety culture 

The patient safety culture in an institution has a great 
impact on patient safety [14]. To enhance patient safety 
and design strategies to reduce medical injuries, there is 
a current focus on measuring the patient safety culture 
[14,15]. The patient safety culture is a component of 
"organisational culture" and reflects the shared beliefs, 
attitudes, values, norms and behavioural characteristics 
of individuals [15,16]. Moreover, it influences staff member 
attitudes and behaviours in relation to their organisations' 
on-going patient safety performance [17-19]. The patient 
safety climate is another component of the conception 
of "organisational culture" and the terms "culture" and 
"climate" are now used interchangeably in the literature. 

It is difficult to define measurable components of the 
patient safety culture [20], and because of this, a number 
of patient safety climate questionnaires have been devel- 
oped [21,22]. One of these questionnaires, the Hospital 
Survey on Patient Safety Culture (HSOPSC) [21,23,24], 



is recommended for use and has been translated into 
Swedish by a national group [25] . 

The components that are measured in this question- 
naire could be described as the employee's perceptions 
and attitudes about the surface features of the patient 
safety culture [21,26]. Questionnaires can also be used 
to examine the effectiveness of strategies designed to im- 
prove the patient safety culture and patient safety. How- 
ever, the evidence supporting the effectiveness of these 
strategies within hospitals is limited [15]. 

The aim of the present study was to describe the patient 
safety culture in an ED at two different hospitals before 
and after a Quality improvement (QI) project that was 
aimed to enhance patient safety. 

Methods 

Study design and instrument 

A repeated cross-sectional design, using the HSOPSC 
questionnaire before and after a Quality improvement 
project that aimed to enhance patient safety in the ED at 
two hospitals, a county hospital and a university hospital. 
The hospitals are located in two different cities in central 
Sweden. 

County hospital 

The county hospital is a trauma level II centre located in 
a minor city, covering a source population of 251,000. 
The ED at this hospital has an average of 53,000 attend- 
ing patients annually. It serves adults and children in 
four specialties: medical, surgical, orthopaedic and gynae- 
cology. In 2009, at the first questionnaire survey, the ED 
worked with traditional single nurse triage. After triage, a 
junior physician examined the patients. At the commence- 
ment of the study, the ED used a locally-modified version 
of the Manchester Triage Scale [27,28]. The hospital has a 
fast-track percutaneous coronary intervention (PCI) line 
for patients with myocardial infarction and another fast- 
track line for patients with stroke. Both medical and non- 
medical students are in training in the ED. 

University hospital 

The university hospital is a trauma level I centre in the 
capital city of Sweden. The ED serves a population of 
150,000 with medical, surgical and orthopaedic care, and 
the hospital serves a population of 2 million with special- 
ized care, such as oncology and ear, nose and throat care. 
The ED at this hospital has an average of 75,000 attending 
patients annually. In 2008, at the first questionnaire sur- 
vey, the ED used the Adaptive Process Triage (ADAPT) 
scale [27,28] . With ADAPT, a patient was assessed using a 
two-step triage model. In step one, a single nurse assessed 
all patients, and thereafter they were either referred to a 
team triage, consisting of a nurse and an emergency 
physician, or to a senior specialist physician within the 
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ED. The hospital has a fast-track PCI for patients with 
myocardial infarction and another fast-track line for pa- 
tients with stroke. The department conducts continuing 
education of physicians and nurses aiming to become 
specialists in emergency medicine and emergency nurs- 
ing, respectively. Swedish and non-Swedish medical and 
non-medical students are in training in this ED. 

Project aiming for quality improvement at the county 
hospital 

In 2009 (quarter 3), physician triage with a supporting 
team, based on a flow process and lean principles [29], 
was introduced to the internal medicine section of the 
ED in a limited manner. The purpose was to shorten the 
time to first contact with a physician and thereby lead to 
a shorter stay and enhanced patient safety in the ED. The 
model was extended in spring 2010 to be in use from 8:00 



to 16:00, and was further modified in May 2011 to be in 
use from 9:00 to 20:00). In this model, the patients were 
first triaged by a nurse and, if assessed as internal medi- 
cine patients they were transferred directly to a physician, 
a specialist in internal medicine at the ED. 

Physician triage was introduced to the orthopaedic 
section of the ED in 2010 (quarter 3), to be in use from 
10:00 to 16:00 (Figure la), and to the surgical section in 
2012 (quarter 3) for hours 10:00 to 16:00. The ED and 
the Department of Internal Medicine initiated the pro- 
ject, and the hospital management supported the process 
(Figure 2). 

Project aiming for quality improvement at the university 
hospital 

A major organisational change was implemented in the 
ED of the university hospital in 2008, (quarter 3) with 



Before 



Emergency 
Department 
reception 




Junior physician 





After 




Figure 1 The principal organisation of the triage models studied, a) The principal organisation at the ED in the county hospital before and 
after quality improvement project, b) The principal organisation at the ED in the university hospital before and after quality improvement project. 
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2008 Quarter 1 
Measure 1 



2009 Quarter 1 and 3 
Measure 1 



2008 Quarter 3 

Start of quality improvement 

\ 

2009 Quarter 3 

Start of quality improvement* 



2010 Quarter 3 
Measure 2 



2010 Quarter 3 

Start of quality improvement" 



2011 Quarter 2 
Measure 2 



Figure 2 Study timeline. *start of quality improvement in the section of medicine. ** start of quality improvement in the section of orthopaedics. 



the main purpose of enhancing patient safety by improv- 
ing the patient flow in the ED, hence shortening the total 
visit time and the time to be seen by a physician. This 
quality improvement project was based on lean principles 
[29] and involved all specialities in the ED. The model 
consisted of an initial assessment ("spot-check") of the pa- 
tient by the triage nurse before the patient was referred to 
a team consisting of a specialist, a nurse and an assistant 
nurse. If the appropriate team was not available, the triage 
nurse performed an assessment to determine the accept- 
able waiting time for the patient to be seen by a physician 
(Figure lb). The hospital management initiated the project 
and supported the implementation process with external 
facilitators. Improvements were made during the imple- 
mentation process based on the principles of continuing 
improvement, using the PDSA cycle (plan, do, study, and 
act), meaning that adjustments and evaluations are both 
an on-going process. The roles of the nurses and physi- 
cians in the ED within the project were mainly to contrib- 
ute as members of different local groups (Figure 2). 

Hospital survey using the patient safety culture 
questionnaire (HSOPSC) 

The HSOPSC was developed for the Agency for Health- 
care Research and Quality, to obtain a better understand- 
ing of the patient safety culture of an entire hospital or 
of specific departments. HSOPSC has been used pri- 
marily for intra- and inter-institutional comparisons [22]. 
HSOPSC is based on a set of pilot studies carried out in 
21 different hospitals across the USA, involving 1,461 hos- 
pital staff. The original questionnaire consists of 42 items, 
which are grouped in 12 dimensions. HSOPSC is a vali- 
dated and widely used instrument [30]. Blegen et al. have 
concluded that the subscales measuring of the safety cul- 
ture dimensions seem to be moderately reliable and valid 
at both the individual respondent level and at the unit 
level, for which the questionnaire was designed [26]. How- 
ever, they showed that the tool was sensitive to differences 
between hospital units, to differences over time and across 
disciplines. This tool can therefore be used to describe dif- 
ferences in each dimension of the safety culture across 
time, discipline, unit or institution. 

The questionnaire used in this study has been translated 
into Swedish and validated by the Swedish National Board 



of Health and Welfare [25], and it is a modified version of 
the HSOPSC. Two dimensions have been added to the 
Swedish version, Information and support to patients at 
adverse events and Information and support to staff at ad- 
verse events. The questionnaire consists of 51 items, which 
are aggregated into 15 dimensions to measure respon- 
dents' attitudes about various aspects of patient safety 
(Table 1). Each dimension includes one to four items with 
a 5-point Likert scale. Percentages were calculated on the 
number of responses to specific questions or dimensions. 
Responses with scores 1 and 2 were considered negative 
regarding patient safety, 3 was neutral, and 4 and 5 were 
positive. Some questions were negatively worded, so the 
answers were reversed prior to recording into positive or 
negative. The dimensional scores were expressed as per- 
centages of answers within each dimension that indicated 

Table 1 The content of dimensions in the hospital survey 
on patient safety culture questionnaire 

1. Non-punitive response to error 

3 items 

2. Staffing 

4 items 

3. Frequency of event reporting 



3 items 

4. Hospital Management Support 
for patient safety 

3 items 

5. Teamwork Across Hospital Units 

4 items 

6. Hospital Handoff and Transition 
4 items 

7. Information and support to 
patients at adverse events* 

4 items 

8. Information and support to 
staff at adverse events* 

2 items 



9. Overall perception of safety 
4 items 

10. Safety culture dimension at 
Unit level** 

4 items 

11. Organizational Learning- 

Continues Improvement. 

3 items 

12. Teamwork within hospital 

4 items 

13. Communication openness 
3 items 

14. Feedback and 
Communication about error 

3 items 

15. Patient safety grade 

/ item 



*Swedish version. 

**Not answered by physicians. 
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a positive response towards patient safety [31]. Statistically 
significant improvement in outcomes between baseline 
and follow-up is described as a "higher score" or a "posi- 
tive score". In the Swedish manual, an index of < 50 is con- 
sidered low and should lead to action, 51-69 suggests 
potential for improvement, and > 70 indicates that the unit 
is functioning well. 

Data collection and statistical methods 

The HSOPSC questionnaire was administered to the staff 
before and after the quality improvement project, includ- 
ing all registered nurses, assistant nurses, those physicians 
employed at university hospital ED, and those physicians 
who frequently work in the ED at the county hospital. 
Registered nurses and assistant nurses were analysed as 
one group at each hospital. 

The questionnaire was first distributed in 2009 at the 
county hospital and in 2008 at the university hospital. 
The second questionnaire was distributed two years 
after the baseline measurement, i.e., in 2011 and 2010, 
respectively. 

The questionnaire and a cover letter, explaining the pur- 
pose of the study, were given to the staff at information 
meetings. The target group at the county hospital meas- 
urement at baseline was 108 registered nurses/assistant 
nurses and 129 physicians, and at the follow-up there were 
114 registered nurses/assistant nurses and 149 physicians. 
The response rate in the two rounds of questionnaires 
was 86% and 71%, respectively. The target group at the 
university hospital measurement at baseline was 125 
registered nurses/assistant nurses and 55 physicians and 
at the follow-up, 125 registered nurses/assistant nurses 
and 54 physicians. The response rates were 61% and 
70%, respectively. 

The internal loss of responses was less than 5% for all 
questions. Physicians at the county hospital did not re- 
spond to the questions that built up the dimension num- 
ber 10, Safety culture dimension at unit level, as those 
questions concern how the employees obtain support 
from the local management, and the physicians are not 
employed at the ED. Thus, dimension number 10 was 
not included in the comparisons involving physicians, 
and therefore it is 14 dimensions instead of 15 in com- 
parisons in which physicians are included. 

Statistical methods 

The proportions of a positive score at baseline and follow- 
up, by occupation or type of hospital, were analysed using 
the binominal test. All tests were two-tailed, and /(-values 
less than 0.05 were considered statistically significant. The 
statistical analyses were performed using SAS Statistics 
software (SAS Institute Inc., Cary, NC, USA). 



Ethics 

Verbal and written information regarding the aim and 
procedure was given to all staff who were informed that 
they were free to withdraw from the study at any time 
and without declaring any reason to do so. The written 
information consent was obtained for the publication of 
this report accompanying images. 

The Regional Ethics Review board at Uppsala University, 
Uppsala, Sweden approved the study (Approval number: 
2009/414). 

Results 

Characteristics of staff in the two EDs 

The gender distribution was evenly distributed in the 
groups at baseline, but there was a difference for the 
physicians at follow-up, as the proportion of men was 
higher at the county hospital, and the proportion of 
women was higher at the university hospital. The most 
frequent age group was 25-44 years, both at baseline 
and at follow-up, with a predominance of respondents 
aged 25-34 years except for the registered nurses/assistant 
nurses at the county hospital. 

In all groups, the majority of staff had 1-5 years of ex- 
perience in health care, except for the registered nurses/ 
assistant nurses at the county hospital, who mostly had 
more than 21 years' experience. The number of years of 
experience was more evenly distributed for the registered 
nurses/assistant nurses at the university hospital. The pre- 
dominant duration of employment in the ED was 1-5 
years, except for the physicians at the university hospital, 
where a greater proportion at follow-up had less than one 
years' duration of employment (Table 2). 

Changes in the dimensions between baseline and 
follow-up within each hospital 

At the county hospital, there was a difference between 
baseline and follow-up in three of 14 dimensions. Two of 
these dimensions, Team-work within hospital and Com- 
munication openness, showed a positive change, whereas 
the score in Information and support to staff at adverse 
events was lower at follow-up. 

At the university hospital, a difference was observed for 
five dimensions. Whereas two of the dimensions, Team- 
work across hospital units and Team-work within hospital 
showed a higher score, three dimensions were scored lower 
at follow-up, Staffing Information and support to patients 
at adverse events, and Patient safety grade. Thus, the di- 
mension Team-work within hospital was scored more 
positively at both EDs after the intervention (Table 3). 

Changes in the dimensions within each hospital by each 
occupation 

The physician group at the county hospital scored 
higher in three of 14 dimensions at the follow-up, 
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Table 2 Characteristics of the participating staff at the EDs at the two participating hospitals 

County hospital County hospital University hospital University hospital 

Physicians Registered nurses/ Physicians Registered nurses/ 









assistant nurses 






assistant nurses 




n = 86 


n = 92 


n = 83 


n = 83 


n = 23 


n = 35 


n = 85 


n = 99 




n (%) 




n (%) 




n (%) 




n (%) 






Before 


After 


Before 


After 


Before 


After 


Before 


After 


Men 


44 (51) 


59 (62) 


1 7 (20) 


15 (18) 


11 (44) 


14 (38) 


18 (19) 


23 (20) 


Women 


42 (49) 


33 (34) 


66 (79) 


68 (81) 


1 2(48) 


21 (57) 


67 (72) 


76 (68) 


Age groups 


















18-24 


- 


- 


4(5) 


1 (D 


- 


- 


4(4) 


2(2) 


25-34 


41 (48) 


36 (38) 


20 (24) 


22 (26) 


1 2(48) 


21 (57) 


37 (40) 


43 (38) 


35-44 


29 (34) 


30 (31) 


26 (31) 


21 (25) 


8(32) 


1 1 (30) 


15 (16) 


28 (25) 


45-54 


11 (13) 


1 9 (20) 


20 (24) 


22 (26) 


2 (8) 


3 (8) 


16(17) 


18 (16) 


55-64 


5 (6) 


10 (10) 


13 (16) 


1 7 (20) 


3 (12) 


1 (3) 


17 (18) 


8(7) 


> 65 






1 (D 


2(2) 






1 (D 


1 (D 


Number of years in health care 


















< 1 


6(7) 


2(2) 


1 (D 


- 


2 (8) 


2 (5) 


5 (5) 


4(4) 


1-5 


34 (40) 


33 (34) 


20 (24) 


11 (13) 


10 40) 


1 7 (46) 


25 (27) 


25 (22) 


6-10 


1 7 (20) 


14 (15) 


18 (21) 


22 (26) 


6 (24) 


10 (27) 


17 (18) 


28 (25) 


11-15 


13 (15) 


1 9 (20) 


9 (11) 


9(11) 


2 (6) 


4(11) 


10(11) 


18 (16) 


16-20 


3 (4) 


6(6) 


9 (11) 


8(10) 


1 (4) 


2 (5) 


9(10) 


4(4) 


>21 


13 (15) 


22 (23) 


27 (32) 


34 (41) 


3 (12) 


2 (5) 


23 (25) 


23 (20) 


Number of years you have 
worked in this unit 


















< 1 


26 (30) 


21 (22) 


14 (17) 


10 (12) 


6(24) 


15 (41) 


21 (23) 


19(17) 


1-5 


33 (38) 


34 (35) 


32 (38) 


35 (42) 


1 1 (44) 


13 (35) 


26 (28) 


43 (38) 


6-10 


14 (16) 


16(17) 


16 (19) 


13 (16) 


4(16) 


8 (22) 


24 (26) 


20 (18) 


11-15 


3 (3) 


13 (16) 


6(7) 


11 (13) 


1 (4) 


1 (3) 


4(4) 


12 (10) 


16-20 


4(5) 


4(4) 


7 (8) 


4(5) 






4(4) 


2(2) 


>21 


3 (3) 


7(7) 


8 (10) 


11 (13) 






7 (7.5) 


4(4) 



Overall perception of safety, Team-work within hospital, 
and Organizational learning-continuous improvement. 

For the physician group at the university hospital, a 
difference between baseline and follow-up was observed 
in two of the dimensions: Team-work across hospital 
units scored higher at follow-up, whereas Staffing scored 
lower at follow-up. 

We observed a change in six of 15 dimensions for the 
registered nurses/assistant nurses at the county hospital. 
Two of these dimensions, Safety culture dimension at 
unit level and Communication openness scored higher, 
whereas the scores in Team-work across hospital units, 
Information and support to patients at adverse events, 
Information and support to staff at adverse events, and 
Organizational learning-continuous improvement scored 
lower at follow-up. 

We observed a change in four of 15 dimensions for 
the registered nurses/assistant nurses at the university 



hospital. One of these dimensions, Team-work within 
hospital, showed a higher score at follow-up and three 
dimensions, Frequency of event reporting, Information 
and support to patients at adverse events, and Patient 
safety grade scored lower. The score for team-work in- 
creased for physicians at both hospitals and for regis- 
tered nurses/assistant nurses at the university hospital 
(Table 4). 

Changes in the dimensions between occupations at 
baseline and follow-up by hospital 

At the county hospital, a difference between physicians 
and nurses/assistant nurses was observed at baseline in 
five of 14 dimensions. The nurses/assistant nurses had a 
higher score in four dimensions, Hospital hand-off and 
transition, Organizational learning-continuous improve- 
ment, Team-work within hospital, and Feedback and 
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Table 3 Changes in the dimensions between baseline and follow-up within each hospital 



Dimension 



County hospital 



University hospital 



Baseline Follow-up Change p-value Baseline Follow-up Change p-value 





% 


% 


a 




% 


% 


a 




All participants' responses 


n 172 


n 181 






n 118 


n 149 






1. Non-punitive response to error 


31.8 


31.9 




NS 


48.3 


43.0 




NS 


2. Staffing 


26.8 


24.6 




NS 


52.1 


45.9 


_ 


* 


3. Frequency of event reporting 


21.9 


23.6 




NS 


27.3 


16.1 




NS 


4. Hospital management Support for patient safety 


13.7 


16.1 




NS 


36.9 


34.7 




NS 


5. Team-work across hospital units 


31.3 


27.8 




NS 


34.7 


43.0 


+ 


*** 


6. Hospital Hand-off and transition 


34.6 


32.9 




NS 


46.8 


46.6 




NS 


7. Information and support to patients at adverse events 


44.8 


40.1 




NS 


46.3 


32.7 




** 


8. Information and support to staff at adverse events 


37.6 


29.7 






28.2 


31.7 




NS 


9. Overall perception of safety 


24.3 


27.1 




NS 


44.6 


41.6 




NS 


11. Organizational learning-continuous improvement 


37.4 


35.9 




NS 


48.4 


52.8 




NS 


12. Team-work within hospital 


56.9 


63.3 


+ 




71.7 


80.1 


+ 




13. Communication openness 


51.2 


57.9 


+ 




66.0 


61.8 




NS 


14. Feedback and communication about error 


45.8 


50.1 




NS 


48.9 


46.0 




NS 


15. Patient safety grade 


62.0 


56.7 




NS 


91.1 


82.0 




# 



a Direction of the change from baseline measurement to follow-up. 
»»* = p < 0.001 , ** = p < 0.01 , * = p < 0.05, NS = not significant. 

An index of < 50 is considered low and should lead to action, 51-69 suggests potential for improvement, and > 70 indicates that the unit is functioning well 



communication about error, and they had a lower score 
in Patient safety grade. 

At the follow-up, eight dimensions differed between 
the physicians and the nurses/assistant nurses. The phy- 
sicians scored higher in seven dimensions, Non-punitive 
response to error, Staffing, Hospital management support 
for patient safety, Team-work across hospital units, Hos- 
pital hand-off and transition, Information and support 
to patients at adverse events, Overall perception of safety, 
and Patient safety grade. They scored lower in Feedback 
and communication about error, which was the only di- 
mension for which physicians scored lower than nurses/ 
assistant nurses at both baseline and follow-up. At the 
university hospital, a difference between physicians and 
nurses/assistant nurses was observed at baseline in three 
of 14 dimensions. The physicians scored higher in Staff- 
ing Overall perception of safety, and Communication 
openness. At follow-up, the physicians scored higher in 
two dimensions, Overall perception of safety and organisa- 
tional learning-continous improvement. Overall perception 
of safety was the only dimension for which physicians 
scored higher than nurses/assistant/nurses at both base- 
line and follow-up (Table 5). 

Discussion 

The main findings were that the staff at both hospitals 
scored more positively in the dimension Team-work 
within hospital after implementing a new working model, 
aiming to improve patient flow in the ED. An improvement 



was also seen in the dimension Communication openness 
at the county hospital and Team-work across units at the 
university hospital. 

For the two overall questions Patient safety grade and 
Overall perception of patient safety there was a tendency 
for both physicians and registered nurses/assistant nurses 
to estimate a lower value after the quality improvement, 
except for the physicians at the county hospital who esti- 
mated a significantly higher value for Overall perception of 
safety. 

Quality improvement with different implementation 
strategies 

Improvement for the dimensions Team-work across hos- 
pital and Team-work within hospital can likely be ex- 
plained by the quality improvement project that was based 
on lean principles, of which one is "building in quality", 
which emphasizes team-work. The role for each team 
member, as well as the organization of patient flow, is one 
of the major focuses of improvements using lean princi- 
ples [29]. The relatively small improvements in perform- 
ance between the first and second measurements in the 
present study may be because no special efforts were 
made in the form of leadership training or team training, 
both of which are well-documented measures for patient 
safety improvement [6]. The quality improvement project 
resulted in no significant difference in the dimensions 
concerning Overall patient safety. However, the university 
hospital results showed a lower score for the dimension 
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Table 4 Changes in the dimensions within each hospital by occupation 



Dimension 




County hospital 






University hospital 




Base-line 


Follow-up 


Change 


P-value 


Base-line 


Follow-up 


Change 


P-value 


Target group 


W 729 


N 749 






W55 


N54 






Physicians' responses 


n 86 

% 


n 96 

% 






n 25 

% 


n 37 

% 






1. Non-punitive response to error 


33.3 


36.0 


a 


NS 


49.7 


43.2 


a 


NS 


2. Staffing 


28.3 


28.1 




NS 


62.9 


48.6 


- 


* 


3. Frequency of event reporting 


19.9 


22.8 




NS 


23.0 


15.0 




NS 


4. Hospital management support for patient safety 


15.8 


20.2 




NS 


42.0 


41.8 




NS 


5. Team-work across hospital units 


29.9 


32.5 




NS 


29.8 


42.8 


+ 


* 


6. Hospital hand-off and transition 


29.8 


33.3 




NS 


44.9 


42.6 




NS 


7. Information and support to patients at adverse events 


43.7 


46.2 




NS 


40.2 


33.3 




NS 


8. Information and support to staff at adverse events 


32.4 


29.3 




NS 


32.5 


32.2 




NS 


9. Overall perception of safety 


25.1 


32.5 


+ 


* 


54.2 


49.3 




NS 


11. Organizational learning-continuous improvement 


28.0 


37.3 


+ 


* 


55.3 


61.1 




NS 


1 2. Team work within hospital 


50.3 


65.3 


+ 




79.6 


77.6 




NS 


13. Communication openness 


55.3 


56.8 




NS 


76.4 


66.4 




NS 


14. Feedback and communication about error 


34.8 


42.4 




NS 


54.0 


46.8 




NS 


15. Patient safety grade 


73.3 


66.3 




NS 


91.7 


88.9 




NS 


Target group 


N 108 


W 7 74 






W 725 


W 725 






Registered nurses' + assistant nurses' responses 


n 86 


n 85 






n 93 


n 112 








% 


% 






% 


% 






1. Non-punitive response to error 


30.3 


27.4 




NS 


47.9 


42.9 




NS 


2. Staffing 


25.2 


20.8 




NS 


49.2 


44.9 




NS 


3. Frequency of event reporting 


24.0 


24.5 




NS 


28.6 


16.4 


- 


** 


4. Hospital management support for patient safety 


11.6 


11.6 




NS 


35.3 


32.1 




NS 


5. Team work across hospital units 


32.8 


22.6 


- 




36.1 


43.0 




NS 


6. Hospital hand-off and transition 


39.4 


32.5 




NS 


47.4 


48.1 




NS 


7. Information and support to patients at adverse events 


45.8 


34.2 


- 




48.3 


32.6 


- 


**» 


8. Information and support to staff at adverse events 


42.6 


30.1 




* 


26.7 


31.5 




NS 


9. Overall perception of safety 


23.4 


21.3 




NS 


42.0 


39.0 




NS 


10. Safety culture dimension unit level 


40.5 


52.3 


+ 




56.5 


52.7 




NS 


11. Organizational learning-continuous improvement 


46.1 


34.5 






46.6 


50.0 




NS 


12. Team- work within hospital 


63.7 


61.0 




NS 


69.6 


81.0 


+ 


*** 


13. Communication openness 


47.1 


59.1 


+ 




63.0 


60.2 




NS 


14. Feedback and communication about error 


56.7 


58.3 




NS 


47.5 


45.7 




NS 


15. Patient safety grade 


50.1 


46.2 




NS 


90.9 


79.6 







a Direction of the change from baseline measurement to follow-up . *»* = p < 0.001, ** = p < 0.01, * = p < 0.05, NS = not significant. An index of < 50 is considered 
low and should lead to action, 51 - 69 suggests potential for improvement, and > 70 indicates that the unit is functioning well. 



Patient safety grade at follow-up. These poor results for 
Patient safety grade may be explained by the top-down 
initiation of the change process, and hence the lack of sup- 
port at the unit level. As the main purpose of the project 
was to improve patient flow and the working environ- 
ment, the aspect of patient safety may not have been com- 
municated very clearly to the staff. 



Another explanation for the observed results may be 
that the quality improvement project was not fully imple- 
mented at the county hospital at the time of follow-up, 
and that only one year had elapsed between the quality 
improvement project and the follow-up. Implementation 
studies show that the effect of quality improvement is rela- 
tively low during the first year after implementation [32] . 
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Table 5 Changes in the dimensions between occupations at baseline and follow-up by hospital 


Dimension 




Baseline 






Follow up 




Physicians 


Registered nurses/ 
assistant nurses 


P-value 


Physicians 


Registered nurses/ 
assistant nurse 


P-value 


Target group 


N 129 


N 108 




N 149 


N 114 




County Hospital responses 


n 86 


n 86 




n 96 


n 85 






% 


% 




% 


% 




1 . Non-punitive response to error 


33.3 


30.3 


NS 


36.0 


27.4 


# 


2. Staffing 


28.3 


25.2 


NS 


28.1 


20.8 


* 


3. Frequency of event reporting 


19.9 


24.0 


NS 


22.8 


24.5 


NS 


4. Hospital management support for patient safety 


15.8 


11.6 


NS 


20.2 


11.6 


** 


5. Team-work across hospital units 


29.9 


32.8 


NS 


32.5 


22.6 


*« 


6. Hospital hand-off and transition 


29.8 


39.4 




33.3 


32.5 


NS 


7. Information and support to patients at adverse events 


43.7 


45.8 


NS 


46.2 


34.2 




8. Information and support to staff at adverse events 


32.4 


42.6 


NS 


29.3 


30.1 


NS 


9. Overall perception of safety 


25.1 


23.4 


NS 


32.5 


21.3 




11. Organizational learning-continuous improvement 


28.0 


46.1 


«** 


37.3 


34.5 


NS 


12. Teamwork within hospital 


50.3 


63.7 


**. 


65.3 


61.0 


NS 


13. Communication openness 


55.3 


47.1 


NS 


56.8 


59.1 


NS 


14. Feedback and communication about error 


34.8 


56.7 


*** 


42.4 


58.3 


** 


15. Patient safety grade 


73.3 


50.1 


« 


66.3 


46.2 


** 


Target group 


W55 


N 125 




N54 


N 125 




University Hospital responses 


n 25 


n 93 




n 37 


n 112 






% 


% 




% 


% 




1. Non-punitive response to error 


49.7 


47.9 


NS 


43.2 


42.9 


NS 


2. Staffing 


62.9 


49.2 


« 


48.6 


44.9 


NS 


3. Frequency of event reporting 


23.0 


28.6 


NS 


15.0 


16.4 


NS 


4. Hospital management support for patient safety 


42.0 


35.3 


NS 


41.8 


32.1 


NS 


5. Team-work across hospital units 


29.8 


36.1 


NS 


42.8 


43.0 


NS 


6. Hospital hand-off and transition 


44.9 


47.4 


NS 


42.6 


48.1 


NS 


7. Information and support to patients at adverse events 


40.2 


48.3 


NS 


33.3 


32.6 


NS 


8. Information and support to staff at adverse events 


32.5 


26.7 


NS 


32.2 


31.5 


NS 


9. Overall perception of safety 


54.2 


42.0 




49.3 


39.0 


* 


11. Organizational learning-continuous Improvement 


55.3 


46.6 


NS 


61.1 


50.0 


* 


12. Teamwork within hospital 


79.6 


69.6 


NS 


77.6 


81.0 


NS 


13. Communication openness 


76.4 


63.0 




66.4 


60.2 


NS 


14. Feedback and communication about error 


54.0 


47.5 


NS 


46.8 


45.7 


NS 


15. Patient safety grade 


91.7 


90.9 


NS 


88.9 


79.6 


NS 



*** = p < 0.001, ** = p < 0.01, * = p < 0.05, NS = not significant. An index of < 50 is considered low and should lead to action, 51-69 suggests potential for 
improvement, and > 70 indicates that the unit is functioning well. 



There were different implementation strategies at the 
two EDs, which may explain the different results at the 
two hospitals. At the county hospital, the quality im- 
provement project was initiated by the physicians from a 
bottom-up perspective, whereas at the university hos- 
pital, the initiative was top-down with external facilita- 
tors, giving little room for the staff to influence quality 
improvement. As health care is regarded as a complex 



system, it is important to use comprehensive approaches 
targeting different levels, settings and groups to enhance 
the implementation effect [13,32]. 

One factor that may have complicated the implemen- 
tation process could be the steady increase in patient 
numbers at both EDs during recent years. It was shown 
in a previous study that staff frustration was accentuated 
when the waiting time at the ED is considered non- 
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acceptable [33]. In the same study it was shown that 
much of this frustration also were connected to issues 
concerning leadership, work organization, and lack in 
patient safety culture, which also could have been a 
complicating factor for the implementation. 

Another finding was that the staff at the university 
hospital scored higher than the staff at the county hos- 
pital in all dimensions at both measurements except for 
the dimensions Frequency of event reporting, Information 
and support to patients after adverse events, and Feed- 
back and communication about error. These findings 
demonstrate the important role played by the hospital 
management in achieving patient safety. Frequent con- 
tributors to medical injuries in health care are failures in 
communication and team-work [4]. Improved team- 
work is beneficial for communication, and vice versa [5]. 
This may explain the positive result for the dimension 
Communication openness at the county hospital. 

The effect of quality improvement by occupation 
Physicians 

The improved results for the physicians at the county 
hospital in the dimensions Overall perceptions of safety, 
Team-work within unit, and Organizational learning- 
continuous improvement may suggest that they had better 
control and supervision of the patients and the patient 
flow. Currently, senior physicians working in a team are in 
the first receiving line for patients, instead of the previous 
regimen with initial nursing triage and junior physicians at 
the second stage. The co-operation between staff groups 
has also increased. Moreover, as previously addressed, the 
quality improvement process at this hospital was based on 
initiatives by internal medicine physicians. 

Physicians at the university hospital improved their 
scores in the dimension Team-work across hospital. One 
explanation for this may be the new model of working 
in accordance with lean principles, which, as previously 
mentioned, emphasize team-work. In this case, it may also 
have affected team-work across the hospital, as the physi- 
cians in the ED need to co-operate with both specialists 
from other departments within the hospital and with 
nurses in different units in the hospital to enhance a better 
flow between the ED and these units. Another factor that 
may have influenced the results is that the physicians are 
responsible for hand-off communication. The negative 
change at the university hospital in the dimension Staffing 
may be interpreted as an expression of increased work- 
load, as well as difficulties in having a specialist in place in 
every team for all shifts. An additional explanation may be 
the difference in experience of the staff at the unit between 
baseline and follow-up, as at follow-up there were an 
increased proportion of physicians who had worked in 
the ED for less than one year. 



Registered nurses/assistant nurses 

The positive change in the dimensions Safety culture 
dimension unit level and Communication openness may 
be because of the new organization structure at the county 
hospital, with senior physicians in the initial receiving line 
for patients and an emphasis on team-work instead of 
the previous model. At the university hospital, registered 
nurses/assistant nurses scored Team work within hospital 
higher at the follow-up, which was in accordance with the 
physicians at the same ED. 

Negative changes were shown for Team-work across 
hospital units, Information and support to staff at adverse 
events, and Organizational learning-continuous improve- 
ment at the county hospital and for Frequency of event 
reporting and Patient safety grade at the university hos- 
pital. In addition, registered nurses/assistant nurses at 
both hospitals scored lower at follow-up for Information 
and support to patients at adverse events. One explanation 
for some of the negative results may be that the quality 
improvement process did not include any team-training 
program or communication programs, which were linked 
with positive results in two other studies [4,6]. One of 
these reported a positive effect on two of 12 dimensions of 
HSOPSC, Frequency of event reporting and Organizational 
learning, after a quality improvement project including 
communication team training, using Team-STEPPS [4]. 
The other study showed positive changes in four dimen- 
sions of HSOPSC, Team-work within unit, Feedback and 
communication, Communication openness, and Overall 
patient safety grade after quality improvement with the 
same Team-STEPPS training program [6]. 

Differences between occupations at baseline and at 

follow-up 

County hospital 

At baseline, the results for the county hospital showed a 
higher score in four of five dimensions for registered 
nurses/assistant nurses compared with physicians. At the 
follow-up, the physicians scored higher than registered 
nurses/assistant nurses in eight dimensions. One of these 
dimensions was Overall perception of safety. The higher 
score could be explained by the introduction of specialists 
instead of junior physicians as the initial recipients of the 
patients. The same explanation may be valid for the scores 
for Patient safety grade. Although both groups scored 
lower at follow-up, the physicians still scored higher than 
registered nurses/assistant nurses. 

University hospital 

At the university hospital, the physicians are employed at 
the ED, which may explain why there were few differences 
between registered nurses/assistant nurses and physicians 
both at baseline and follow-up. Thus, both groups shared 
the staffing conditions, and they all shared the same daily 
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environment and the same values set by the department. 
One of the dimensions, Patient safety grade was scored 
higher by the physicians both at baseline and follow-up, 
which could be an expression of the physicians' role in the 
team, as, in contrast to the registered nurses/assistant 
nurses, they are in control of the treatment plan for the 
patients and hence able to plan the next move. It is also 
possible that the treatment plan may not been sufficiently 
communicated to the team. 

Limitations 

Measuring patient safety culture by a questionnaire is self- 
limiting, as patient safety culture is a multifaceted concept. 
It has been shown that it is difficult to define measurable 
components of patient safety culture [20], illustrated by 
the fact that a number of different patient safety climate 
questionnaires have been developed [21,22]. One way to 
overcome this is to use a mixed method design, which was 
not used in this study. 

Another limiting factor of this study was that the study 
groups were not identical at the two measurement time 
points. Another factor that may have influenced the result 
was that a higher proportion of physicians at the university 
hospital than at the county hospital had worked in the ED 
for less than one year. Only a few positive differences were 
seen between baseline and follow-up, which may be ex- 
plained by a limited effect of the quality improvement 
project itself. It is possible that the result may have been 
improved in further dimensions for all the staff if the 
quality improvement project had included areas such as 
communication skills and team-work training together 
with the changes to improve patient flow, and provided 
that the implementation process had been systematic. 
The time span between the quality improvements and 
the second measurement could also be questioned, since 
changes take time. 

Conclusion 

The result showed improvements relating to team-work 
and communication openness. Most of the improve- 
ments at follow-up were seen for the physicians, mainly 
at the county hospital in dimensions Overall perception 
of safety, Team-work within hospital, and Organisational 
learning- continuous improvement. Overall, the physicians 
at the university hospital scored higher in the majority of 
the dimensions than those at the county hospital. The low 
number of positive changes seen could have been influ- 
enced by the lack of team training and communication 
programs in connection with the implementation of the 
new work model, which previous studies have shown to 
be of importance. Further, a cultural change is challenging 
and takes time, and the time from implementation to 
follow-up may have been too short for the staff to experi- 
ence any effect on patient safety. 



Competing interests 

None of the authors report any competing interests. 
Authors' contributions 

LB, AL, M-LE and ME conceived the study, collected data, analysed and 
interpreted data and drafted the manuscript. AB analysed and interpreted 
data and drafted the manuscript. All authors read and approved the final 
manuscript. 

Acknowledgements 

The authors wish to thank the staff at the participating emergency 
departments. 

Author details 

Centre for Clinical Research, Uppsala University, Vastmanlands County 
Hospital, Vasteras, Sweden, department of Emergency Medicine, Karolinska 
University Hospital, Stockholm, Sweden. 3 Department of Medicine, Karolinska 
Institutet, Solna, Sweden. 4 Department of Surgical Sciences, Uppsala 
University, Uppsala University Hospital, Uppsala, Sweden. 

Received: 13 June 2013 Accepted: 27 June 2014 
Published: 9 July 2014 

References 

1 . Vincent C: Patient Safety. Chichester: Wiley-Blackwell; 201 0. 

2. Patient safety law (Patientsakerhetslag): Swedish Code of Statutes: 
SFS.20W:659 (Svensk forfattningssamling: SFS. 20i0:659). Stockholm: 
Government Offices (Regeringskansliet); 2010. 

3. National Board of Health and Welfare (Socialstyrelsen): Medical Harm in 
Somatic Care (Vardskador inom somatisk slutenvard). Stockholm: National 
Board of Health and Welfare (Socialstyrelsen); 2008. 

4. Stead K, Kumar S, Schultz TJ, Tiver S, Pirone CJ, Adams RJ, Wareham CA: 
Teams communicating through STEPPS. Med J Aust 2009, 1 90:S 1 28-S1 32. 

5. Leonard M, Graham S, Bonacum D: The human factor: the critical 
importance of effective teamwork and communication in providing safe 
care. Qual Saf Health Care 2004, 13(Suppl I):i85-i90. 

6. Weaver SJ, Lubomksi LH, Wilson RF, Pfoh ER, Martinez KA, Dy SM: 
Promoting a culture of safety as a patient safety strategy: a systematic 
review. Ann Intern Med 2013, 158:369-374. 

7. Grol RP, Bosch MC, Hulscher ME, Eccles MP, Wensing M: Planning and 
studying improvement in patient care: the use of theoretical 
perspectives. Milbank 0 2007, 85:93-138. 

8. Wheelan SA, Burchill CN, Tilin F: The link between teamwork and patients' 
outcomes in intensive care units. Am J Crit Care 2003, 12:527-534. 

9. Horwitz LI, Meredith T, Schuur JD, Shah NR, Kulkarni RG, Jeng GY: Dropping 
the baton: a qualitative analysis of failures during the transition from 
emergency department to inpatient care. Ann Emerg Med 2009, 
53:701-710. e704. 

10. Dhingra KR, Elms A, Hobgood C: Reducing error in the emergency 
department: a call for standardization of the sign-out process. Ann Emerg 
Med 2010, 56:637-642. 

1 1 . Cheung DS, Kelly JJ, Beach C, Berkeley RP, Bitterman RA, Broida Rl, Dalsey 
WC, Farley HL, Fuller DC, Garvey DJ, Klauer KM, McCullough LB, Patterson 
ES, Pham JC, Phelan MP, Pines JM, Schenkel SM, Tomolo A, Turbiak TW, 
Vozenilek JA, Wears RL, White ML: Improving handoffs in the emergency 
department. Ann Emerg Med 2010, 55:171-180. 

12. Berg LM, Ehrenberg A, Florin J, Ostergren J, Goransson KE: An observational 
study of activities and multitasking performed by clinicians in two 
Swedish emergency departments. Eur J Emerg Med 2012, 19:246-251. 

13. Rasmussen J: The Concept of Human Error: Is it Useful for the Design of 
Safe Systems in Health Care? In Risk and Safety in Medicine. Edited by 
Vincent C, deMoll B. London: Elsevier; 1999. 

14. Singer SJ, Falwell A, Gaba DM, Meterko M, Rosen A, Hartmann CW, Baker L: 
Identifying organizational cultures that promote patient safety. Health 
Care Manage Rev 2009, 34:300-31 1. 

15. Morello RT, Lowthian J A, Barker AL, McGinnes R, Dunt D, Brand C: 
Strategies for improving patient safety culture in hospitals: a systematic 
review. BMJ Qual Saf 2013, 22:11-18. 

16. Nieva VF, Sorra J: Safety culture assessment: a tool for improving patient 
safety in healthcare organizations. Qual Saf Health Care 2003, 
12(Suppl 2):iil7-ii23. 



Burstrom et ah BMC Health Services Research 2014, 14:296 
http://www.biomedcentral.com/1472-6963/14/296 



Page 12 of 12 



1 7. Davies HT, Nutley SM, Mannion R: Organisational culture and quality of 
health care. Qual Health Care 2000, 9:1 11-119. 

18. Guldenmund FW: (Mis)understanding safety culture and its relationship 
to safety management. Risk Anal 2010, 30:1466-1480. 

19. Palmieri PA, Peterson LT, Pesta BJ, Flit MA, Saettone DM: Safety culture as a 
contemporary healthcare construct: theoretical review, research 
assessment, and translation to human resource management. In Strategic 
Human Resource Management in Health Care. Volume 9. Edited by Fottler 
MD, Khatri N, Savage GT. University of Missouri, USA: Emerald Group 
Publishing Limited; 2010:97-133. Advances in Health Care Management. 

20. Cooper MD: Towards a model of safety culture. Saf Sci 2000, 36:1 1 1-136. 

21. Fl in R, Burns C, Mearns K, Yule S, Robertson EM: Measuring safety climate 
in health care. Qual Saf Health Care 2006, 15:109-115. 

22. Colla JB, Bracken AC, Kinney LM, Weeks WB: Measuring patient safety 
climate: a review of surveys. Qual Saf Health Care 2005, 14:364-366. 

23. Hammer A, Ernstmann N, Ommen O, Wirtz M, Manser T, Pfeiffer Y, Pfaff H: 
Psychometric properties of the Hospital Survey on Patient Safety Culture 
for hospital management (HSOPS_M). BMC Health Sen Res 2011, 11:165. 

24. Sorra JS, Dyer N: Multilevel psychometric properties of the AHRQ hospital 
survey on patient safety culture. BMC Health Sen Res 2010, 10:199. 

25. National Board of Health and Welfare (Socialstyrelsen): 7b Measure Patient 
Safety Culture - Handbook for Patient Safety Work (Att Mata Patientsakerhets- 
kulturen - Handbok for Patientsdkerhetsarbete). Stockholm: National Board of 
Health and Welfare (Socialstyrelsen); 2009. 

26. Blegen MA, Gearhart S, O'Brien R, Sehgal NL, Alldredge BK: AHRQ's hospital 
survey on patient safety culture: psychometric analyses. J Patient Saf 
2009, 5:139-144. 

27. Asplund K, Castren M, Ehrenberg A, Farrokhnia N, Goransson K, Jonsson H, 
Lind L, Marke LA, Norlund A, Oredsson S: Triage och flodesprocesser pa 
akutmottagningen. En systematisk litteraturoversikt. Stockholm: Swedish 
Council of Health Technology Assessemet (SBU); 2010. 

28. Farrokhnia N, Goransson KE: Swedish emergency department triage and 
interventions for improved patient flows: a national update. Scand J 
Trauma Resusc Emerg Med 201 1, 19:72. 

29. Going Lean in Health Care, http://www.ihi.org. 

30. Hedskold M, Pukk-Harenstam K, Berg E, Lindh M, Soop M, Ovretveit J, 
Andreen Sachs M: Psychometric properties of the hospital survey on 
patient safety culture, HSOPSC, applied on a large Swedish health care 
sample. BMC Health Serv Res 2013, 13:332. 

31. Hospital survey on patient safety culture: 2009 comparative database 
report. http//www.ahrq,gov, 

32. Grol R, Grimshaw J: From best evidence to best practice: effective 
implementation of change in patients' care. Lancet 2003, 362:1225-1230. 

33. Burstrom L, Starrin B, Engstrom ML, Thulesius H: Waiting management at 
the emergency department - a grounded theory study. BMC Health Serv 
Res 2013, 13:95. 



doi:1 0.1 1 86/1 472-6963-1 4-296 

Cite this article as: Burstrom et at: The patient safety culture as perceived 
by staff at two different emergency departments before and after 
introducing a flow-oriented working model with team triage and lean 
principles: a repeated cross-sectional study. BMC Health Services Research 
2014 14:296. 



Submit your next manuscript to BioMed Central 
and take full advantage of: 

• Convenient online submission 

• Thorough peer review 

• No space constraints or color figure charges 

• Immediate publication on acceptance 

• Inclusion in PubMed, CAS, Scopus and Google Scholar 

• Research which is freely available for redistribution 



Submit your manuscript at f \ n! _, ul _-| r Q r,tr=l 

www.biomedcentral.com/submit B,onne «« central 



V 



